About

Abu Yasar Arafath A is an experienced Business Intelligence Analyst and Data Engineer with over 5 years of relevant experience. Currently working as a Data Engineer at junglee, he has successfully delivered an ETL orchestration solution for ODS to Cloud migration, using Jenkins, PySpark, Python, EC2, EMR, and Snowflake to load data from legacy on-premise ADS and ODS onto the cloud. He has also worked on the migration of live and near real-time data to s3 and Snowflake, which will be later pulled by the BI team to build business reports. Abu Yasar Arafath A is responsible for data-migration activities, developing various PySpark jobs and scheduling them through airflow to migrate the data. He has developed reconciliation jobs to fix the data in case of any mismatch between source and target. Additionally, he has developed multiple streaming jobs to migrate the live data from Kafka to s3 and Snowflake. He is responsible for fixing the data in case of data discrepancy (Athena and Snowflake). He has also developed the architecture to generalize the data migration by just passing the dependent parameters, which has avoided the redundant development activities. He has developed Jenkins Pipeline Job for CI/CD activities. Abu Yasar Arafath A has previously worked as a Software Engineer and Associate Software Engineer at teksystems. He has worked collaboratively to deliver an ETL orchestration solution for ODS to Cloud migration, using Kubernetes, Docker, PySpark, Python, EC2, RDS, and Lambda functions to load data from legacy on-premise ADS and ODS onto the cloud. He has worked as part of a team implementing ETL processes and integration of data from multiple data sources by writing PySpark jobs on a cluster in a containerized environment and orchestrating the same through Airflow. Abu Yasar Arafath A holds a Bachelor of Technology in Information Technology from PSG College of Technology. He has expertise in Data Engineering, Snowflake, Jenkins, Mobile, ETL, Apache Airflow, Amazon Athena, Python, CI/CD, Software Engineering, Kafka, test, Kubernetes, Docker, and Integration. He is a proactive and result-oriented individual with excellent analytical and problem-solving skills.